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WHAT IS CLAIMED IS: 

1 LA method for converting video data format from interlaced scan rate to 

2 progressive scan rate, said method comprising of a perceptual model to determine 

3 membership probabihties of field samples (pixels) with regard to a plurality of image 

4 components of a field, said determination prioritizes the contributions from said image 

5 components, where the said image components are a static image component, a texture image 

6 component, and a motion image component. 

1 2. The method of claim 1, where the interpolated samples of the final progressive 

2 frame is obtained by summing the modulated or adjusted versions of a plurality of image 

I=s3 components. 

pi 

1 3 . The method of claim 2, where a current field, a past field and a future field are 

fl^p all partitioned into blocks of samples (pixels), and the image components are computed for 

^"3 samples of a block of the said current field based on block-based and sub-block-based 

s 4 perceptual parameters obtained from samples of the said current field, said past field, and said 

p5 fiiture field. 

pi 4. The method of claim 3, where adjustment of the static image component is 

^2 comprised of reducing the said component by a modulated version of the said component, 

3 where the said modulation factor is Ra and is comprised of scaling an aed factor by fL4/, the 

4 said aed is derived by computing the average energy of the difference between a block in 

5 future field and a prediction of the said block in past field, and further, the said RAI is 

6 obtained by computing the unage difficulty of a block in current field. 

1 5 . The method of claim 4, where the modulation factor Ra is incremented by a 

2 term comprised of modulating Ra by a second modulation factor RSa, the said RSa is 

3 comprised of scaling an aeds factor by SVAI, the said aeds is derived by computing the 

4 average energy of the difference between a sub-block in future field and a prediction of the 

5 said sub-block in past field, the said sub-blocks being subset of blocks of claim 4 or have 

6 some overlapping pixels, and further, the said SVAI is obtained by computing the average 

7 vertical hnage difficulty of the said sub-block in future field and a third sub-block in past 
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8 field, the third sub-block in past field having the same coordinates as the said sub-block in 

9 future field. 

1 6. The method of claims 4 and 5 where both the block and sub-block predictions 

2 use the same motion information. 

1 7. The method of claim 3, where the static image component is modulated by a 



2 factor Rm, said Rm is comprised of scaling the aed factor of claim 4 by aedO where the said 

3 aedO is derived by computing the average energy of the difference between a block in future 

4 field and a corresponding block in past field, the said block in past field having the same 

5 coordinates as the said block in future field. 

1 8. The method of claims 4, 5, 6 and 7 where the same process is used for texture 

2 image component. 

1 9. The method of claims 2, 3, 4, 5, and 7, when the nominal values of Ra and aed 

2 are small, only contributions from static image component and motion image component are 

3 used. 

1 10. The method of claim 9, when a small amount of motion for a block of samples 

2 is detected, the interpolated pixel is a sum of a modulated motion image component and an 

3 adjusted static image component, the said adjustment comprised of reducing the static image 

4 component by a modulated version of the static image component, the said modulation factor 

5 /s Ra as described in claim 4. 



1 11. The method of claim 9, when significant amount of motion for a block of 

2 samples is detected, the interpolated pixel is a sum of a modulated static image component 

3 and an adjusted motion image component, the said adjustment is comprised of reducing the 

4 motion image component by a modulated motion image component, the said modulating 

5 factor being Rm, the same as the modulating factor derived in claim 7 for the static image 

6 component. 

1 12. The method of claim 3, where the static image component is modulated by a 

2 factor Tl , said Tl is comprised of adding an ascending term and a descending term, said 
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3 ascending term is further comprised of modulating Rm by an increasing function Af (Va), 

4 said Rm as described in claim 7, said increasing function increases as the amount of block 

5 motion Va increases, and the said descending term is comprised of modulating the adjustmeait 

6 factor (1 -Ra) by a. decreasing function Df (V a), where the said Ra is described in claim 4, 

7 and the said decreasing function decreases as the amount of block motion Va increases. 

1 13. The method of claims 1 0 and 12 with Ra being replaced by Ra x (1 +RSa), 

2 where RSa is described in claim 5. 

1 14. The method of claims 9 and 12, when moderate amount of motion for a block 

2 of samples is detected, the interpolated pixel is sum of a modulated static image component 

3 and an adjusted motion image component, the said adjustment is comprised of reducing the 
■^4 motion image component by a modulated motion image component, the said modulating 

5 factors being Tl. 

:7 1 15. The method of claim 3 , when the nominal values of Ra and aed are large, only 

^2 contributions from texture image component and motion image component are used, the said 

s 3 values of Ra and aed are defined in claim 4. 

nj 

2=2 1 6. The method of claim 1 5, when a small amount of motion for a block of 

t3 samples is detected, the said block has a dominant texture image component. 

1 1 7. The method of claim 1 6, where the interpolated pixel is a sum of a modulated 

2 motion image component and an adjusted texture image component, the said adjustment 

3 comprised of reducing the texture image component by a modulated version of the texture 

4 image component, the said modulation factors are Rax(l+ RSa), where Ra is defined in 

5 claim 4 and RSa is defined in claim 5. 

1 18. The method of claim 1 5, when significant amount of motion for a block of 

2 samples is detected, the interpolated pixel is a sum of a modulated texture image component 

3 and an adjusted motion image component, the said modulation factor is Rm as defined in 

4 claim 7, and further, the said adjustment is comprised of reducing the motion image 

5 component by a modulated motion image component, the said modulating factor being Rm. 
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1 19. The method of claim 15, where the texture image component is modulated by 

2 a factor Ts, said Ts is comprised of adding an ascending term and a descending term, said 

3 ascending term is defined in claim 12, and the said descending term is comprised of 

4 modulating the adjustment factor (1-Rax(l + RSa)) by a decreasing function Df(Va), 

5 where Df(Va)is described in claim 1 2 and RSa is defined in claim 5 . 

1 20. The method of claims 17 and 19 where factor Rax(l + RSa) is replaced by 

2 Ra. 

1 21. The method of claims 1 5 and 19, when moderate amount of motion for a block 

2 of samples is detected, the interpolated pixel is sum of a modulated texture image component 
^ and an adjusted motion image component, the said modulating factor is Ts and further, the 
^ said adjustment is comprised of reducing the motion image component by a modulated 

fljS motion image component, the said modulating factor being Ts. 
y1 

'^")- 22. The method of claim 3, when the nominal value of Ra is large and the nominal 

s 2 value of aed is small or when the nominal value of Ra is small and the nominal value of aed 

j=».3 is large, the said values of Ra and aed as defined in claim 4, and fiirther, the amoimt of 

nJ4 motion is small for a block of samples, the interpolated pixel is sum of an adjusted spatial 

p5 image component and a modulated motion image component, said adjustment is comprised 

^6 of reducing the spatial image component by a modulated version of the spatial image 

7 component, said modulation factor is Ra x (1+RSa), said spatial image component is further 

8 comprised of summing an adjusted static image component and a modulated texture image 

9 component, said adjustment is comprised of reducing the static image component by a 

1 0 modulated version of the static image component, said modulation factor is RSa, the said RSa 

11 is defined in claim 5 . 

1 23. The method of claim 3, when the nominal value of Ra is large and the nominal 

2 value of aed is small or when the nominal value of Ra is small and the nominal value of aed 

3 is large, the said values of Ra and aed as defined in claim 4, and further, the amount of 

4 motion is significant for a block of samples, the interpolated pixel is sum of a modulated 

5 spatial image component and an adjusted motion image component, said adjustment is 

6 comprised of reducing the motion image component by a modulated version of the motion 
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image component, said modulation factor is Rm, said spatial image component is further 
comprised of summing an adjusted static image component and a modulated texture image 
component, said adjustment is comprised of reducing the static image component by a 
modulated version of the static image component, said modulation factor is RSa, the said RSa 
is defined ia claim 5 and the said Rm is defined in claim 7. 

24. The method of claim 3, when the nominal value of Ra is large and the nominal 
value oiaed is small or when the nominal value of Ra is small and the nominal value ofaed 
is laige, the said values of Ra and aed as defined in claim 4, and fiirther, the amoimt of 
motion is moderate for a block of samples, the interpolated pixel is sum of a modiilated 
spatial image component and an adjusted motion image component, said adjustment is 
comprised of reducing the motion image component by a modulated version of the motion 
image component, said modulation factors are Ts, and further, the said spatial image 
component is sum of a modulated texture image component and an adjusted static image 
component, said adjustment is comprised of reducing the static image component by a 
modulated version of the static image component, said modulation factors are RSa, where the 
said Ts is defined in claim 19 and said RSa is defined in claim 5. 

25. The method of claim 22 where RaxfJ + RSa) is replaced by Ra. 

26. The method of claim 24 where Ts is replaced by T 1 , said T 1 is defined in 
claim 12. 

27. The method of claim 3 where a ratio Ro is obtained for a block of current 
field, said ratio is comprised of adding vertical ratio Rv and horizontal ratio Rh, said vertical 
ratio is obtained firom scaling a vertical block activity indicator by BAI, and further, said 
horizontal ratio is obtained firom scaling a horizontal block activity indicator by BAI, where 
BAI is defined in claim 4. 

28. The method of claim 27, when the magnitude of Ro is small for a block of 
samples in the current field, and further, the amount of motion is not small for the said block, 
the said block is declared to have moving edges. 
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1 29. The condition in claim 28 where only contributions from the texture image 

2 component and motion image component are used. 

1 30. The method of claim 29, when significant amount of motion for a block of 

2 samples is detected, the interpolated pixel is a sum of a modulated texture image component 

3 and an adjusted motion image component, the said modulation factor is Rm as defined in 

4 claim 7, and further, the said adjustment is comprised of reducing the motion image 

5 component by a modulated version of the motion image component, the said modulating 

6 factor being Rm. 

1 31. The method of claim 29, when moderate amount of motion for a block of 
y2 samples is detected, the interpolated pixel is sum of a modulated texture image component 
^ and an adjusted motion image component, the said modulating factor is Ts, and further, the 

said adjustment is comprised of reducing the motion image component by a modulated 

glS version of the motion image component, the said modulating factor being Ts, said Ts is 

r]6 defined in claim 19. 

pi 32. The method in claim 3 1 where Ts is replaced by Tl, said Tl is defined in 

m claim 12. 

O 

^"1 33 . The method of claim 1 , where the perceptual model is assisted by a dual-stage 

2 motion compensation unit. 

1 34. A method for converting video data from interlaced format to progressive 

2 format, comprising: 

3 determining a probabiUty of a first image component of a field, wherein the 

4 determination assigns a priority to the first image component; anA 

5 determining a probability of a second image component of a field, where the 

6 determination assigns a priority to the second image component. 

1 35. The method as recited in claim 34, fiirther comprising: 

2 modulating a first image component to produce a first modulated image component; 
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modulating a second image component to produce a second modulated image 
component; 

summing the first modulated image component and the second modulated image 
component; and 

producing a progressive jframe based on the sum of the first modulated image 
component and the second modulated image component. 

36. The method as recited in claim 34, further comprising: 
partitioning a first field to produce a first block of samples; 
partitioning a second field to produce a second block of samples; 
determining a first image component for the first block of samples; and 
determining a second image component based on the second block of samples. 

37. The method as recited in claim 36, fiirther including: 

modulating the first image component based on an average energy Q'aed") of a 

difference between a block in a future field and a prediction of the block in a 
past field scaled by an image difficulty of a block ("BAI") in the current field. 

3 8 . The method of claim 37, further comprising: 

computing the average energy of the differences between a sub-block in a future 
field and a prediction of the sub-block in a past field; 

computing the average vertical image difficulty of the sub-block in the future field 
and the sub-block in past field, the sub-block in past field having the same 
coordinates as the sub-block in future field; 

modulating the first image component based on the average energy of the 

differences between a sub-block in the future field and a prediction of the sub- 
block in a past field; and 

modulating the first image component based on the average vertical image 

difficulty of the sub-block in the future field and the sub-block in past field, 
the sub-block in past field havmg the same coordinates as the sub-block in 
future field. 

39. The method of claim 37, further comprising: 

predicting a block based upon a first set of motion information; and 
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predicting a sub-block based on the first set of motion information. 

40. The method of claim 36, further including: 

computing the average energy ("aedO") of the difference between a block in a future 
field and a block in a past field, the block in the fixture field having a first set 
of coordinates, the block in the past field having a second set of coordinates, 
wherein the first set of coordinates and the second set of coordinates are 
substantially equal; and 

modulating the first image component based on the average energy of the difference 
between the block in the fiiture field and the block in the past field. 

41 . The method as recited in claim 36, fiirther including: 

modulating the second image component based on an average energy ("aed") of a 
difference between a block in a future field and a prediction of the block in a 
past field scaled by an image difficulty of a block ("BAI") in the current field. 

42. The method of claim 41, further including: 

scaling aed by BAI to produce a modulation factor ("Ra"); and 
if Ra and aed are larger than a threshold value, fiirther including; 
modulating the second image component based on an average energy ("aed") of a 
difference between a block in a future field and a prediction of the block in a 
past field scaled by an image difficulty of a block ("BAI") in the current field. 

43. The method as recited in claim 42, further comprising: 
computing a motion for a block of samples, wherein an interpolated pixel is 

produced if the motion of a block of samples is less than a threshold value; 
modulating a first image component; 
adjusting a second image component; and 

summing the modulated first motion image component and the adjusted second image 
component to produce an interpolated pixel. 
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1 44. The method of claim 42, further comprising: 

2 computing the amount of motion for a block of samples, wherein if the amount of 

3 motion for the block of samples is greater than a threshold value, an 

4 interpolated pixel is produced; 

5 modulating a first image component; 

6 adjusting a second image component, further including; 

7 reducing a second image component by a factor, wherein the factor ("Rm") is 

8 computed by scahng aed by aedO. 

1 45. The method as recited in claim 36, further comprising: 

2 modulating the first image component, including: 

3 summing an ascending term, including 

- 4 increasing a first modulation factor by a function increasing as the 

"5 motion of the block increases; and 

C~-6 summing a descending term, including: 

7 decreasing a second modulation factor by a function decreasing as the 

: 8 motion of the block increases. 

« 1 46. A computer program product for converting video data from interlaced format 
^ to progressive format, comprising: 

3 a set of instructions configured to determine a probability of a first image component 

4 of a field, wherein the determination assigns a priority to the first image 

5 component; and 

6 a set of instructions configured to determine a probability of a second image 

7 component of a field, where the determination assigns a priority to the second 

8 image component. 

1 47. The computer program product as recited in claim 46, further comprising: 

2 a set of instructions configured to modulate a first image component to produce a first 

3 modulated image component; 

4 a set of instructions configured to modulate a second image component to produce a 

5 second modulated image component; 
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a set of instructions configured to produce a progressive frame based on the sum of 
the first modulated image component and the second modulated image 
component. 

48. The computer program product as recited in claim 46, further comprising: 
a set of instructions configured to partition a first field to produce a first block of 

samples; 

a set of instructions configured to partition a second field to produce a second block 
of samples; 

a set of instructions configured to determine a first image component for the first 

block of samples; and 
a set of instructions configured to determine a second image component based on the 

second block of samples. 

49. The computer program product as recited in claim 48, further comprising: 
a set of instructions configured to modulate the first image component based on an 

average energy ("aed") of a difference between a block in a fixture field and a 
prediction of the block in a past field scaled by an image difficulty of a block 
("BAI") in the current field. 

50. The computer program product as recited in claim 49, further comprising: 
a set of instructions configured to compute the average energy of the differences 

between a sub-block in a future field and a prediction of the sub-block in a 
past field; 

a set of instiiictions configured to compute the average vertical image difficulty of 
the sub-block in the fixture field and the sub-block in past field, the sub-block 
in past field having the same coordinates as the sub-block in future field; 

a set of instructions configured to modulate the first image component based on 

the average energy of the differences between a sub-block in the future field 
and a prediction of the sub-block in a past field; and 

a set of instructions configured to modulate the first image component based on 

the average vertical image difficulty of the sub-block in the future field and 
the sub-block in past field, the sub-block in past field having the same 
coordinates as the sub-block in future field. 
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5 1 . The computer program product as recited in claim 49, further comprising: 
a set of instructions configured to predict a block based upon a first set of motion 

information; and 

a set of instructions configured to predict a sub-block based on the first set of motion 
information. 

52. The computer program product as recited in claim 48, fiirther comprising: 
a set of instructions configured to compute the average energy ("aedO") of the 

difference between a block in a first field and a block in a second field, the 
block in the first field having a first set of coordinates, the block in the second 
field having a second set of coordinates, wherein the first set of coordinates 
and the second set of coordinates are substantially equal; and 
a set of instructions configured to modulate the first image component based on the 
average energy of the difference between the block in the first field and the 
block in the second field. 

53. The computer program product as recited in claim 48, fiirther comprising: 
a set of instructions configured to modulate the second image component based 

on an average energy ("aed") of a difference between a block in a future field 
and a prediction of the block in a past field scaled by an image difficulty of a 
block ("BAI") in the current field. 

54. The computer program product as recited in claim 53, fiirther comprising: 
a set of instructions configured to scale aed by BAI to produce a modulation 

factor (also referred to as Ra); and 
a set of instructions configured to determine if Ra and aed are larger than a threshold 
value; and, 

a set of instructions configured, if Ra and aed are greater than a threshold value, to 

modulate the second image component based on an average energy {^'aed") of 
a difference between a block in a fiiture field and a prediction of the block in a 
past field scaled by an image difficulty of a block ("BAI") in a current field. 
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10 55. The computer program product as recited in claim 54, further comprising: 

11 a set of instructions configured to compute a motion for a block of samples, wherein 

12 an interpolated pixel is produced if the motion of a block of samples is less 

1 3 than a threshold value; 

14 modulating a first image component; 

15 adjusting a second image component; and 

16 summing the modulated first image component and the adjusted second image 

17 component to produce an interpolated pixel. 

1 56. The computer program product as recited in claim 54, further comprising: 

2 a set of instructions configured to compute the amount of motion for a block of 

3 samples, wherein if the amount of motion for the block of samples is greater 
~~ 4 than a threshold value, an interpolated pixel is produced; 

Z 5 a set of instructions configured to modulate a first image component; 

6 a set of instructions configured to adjust a second image component, fiirther 

~ 7 comprising: 

8 a set of instructions configured to reduce a second image component by a 

9 factor, wherein the factor (also referred to as "Rm") is computed by scaling 
-10 aed hy aedO. 

1 57. The computer program product as recited in claim 48, further comprising: 

2 a set of instructions configured to modulate the first image component, further 

3 comprising: 

4 a set of instructions configured to simi an ascending term, including 

5 increasing a first modulation factor by a function increasing as the 

6 motion of the block increases; and 

7 a set of instructions configured to sum a descending term, including: 

8 decreasing a second modulation factor by a function decreasing as the 

9 motion of the block increases. 

1 58. A set-top box for de-interlacing video data fi-om interlaced format to 

2 progressive format, comprismg: 

3 a processor, 

4 a memory operably coupled to the processor; 
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means to determine a probability of a first image component of a field, wherein the 
determination assigns a priority to first image component; and 

means to determine a probability of a second image component of a field, where the 
determination assigns a priority to the second image component. 

59. The set-top box as recited in claim 58, further comprising: 

means to modulate a first image component to produce a first modulated image 
component; 

means to modulate a second image component to produce a second modulated image 
component; 

means to sum the first modulated image component and the second modulated image 
component; and 

means to produce a progressive fi-ame based on the sum of the first modulated unage 
component and the second modulated image component. 

60. The set-top box as recited in claim 58, further comprising: 
means to partition a first field to produce a first block of samples; 
means to partition a second field to produce a second block of samples; 
meais to determine a first image component for the first block of sanples; and 
means to determine a second image component based on the second block of samples. 

6 1 . The set-top box as recited in claim 59, further comprising: 

means to modulate the first image component based on an average energy ("aed") of 
a difference between a block in a future field and a prediction of the block in a 
past field scaled by an image difficulty of a block ("BAI") in the current field. 

62. The set-top box as recited in claim 6 1 , further comprising: 

means to compute the average energy of the differences between a sub-block in a 
future field and a prediction of the sub-block in a past field; 

means to compute the average vertical image difficulty of the sub-block in the 

future field and the sub-block in past field, the sub-block in past field having 
the same coordinates as the sub-block in future field; 

means to modulate the first image component based on the average energy of the 
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9 differences between a sub-block in the foture field and a prediction of the sub- 

1 0 block in a past field; and 

1 1 means to modulate the first image component based on the average vertical 

1 2 image difficulty of the sub-block in the fiiture field and the sub-block in past 

13 field, the sub-block in past field having the same coordinates as the sub-block 

14 in future field. 

1 63 . The set-top box as recited in claim 6 1 , fiirther comprising: 

2 means to predict a block based upon a first set of motion information; and 

3 means to predict a sub-block based on the first set of motion information. 

1 64. The set-top box as recited in claim 60, further comprising: 

means to compute the average energy (also referred to as aedO) of the difference 
^3 between a block in a fixture field and a block in a past field, the block in the 

riJ4 fiiture field having a first set of coordinates, the block in the past field having a 

g4:5 second set of coordinates, wherein the first set of coordinates and the second 

h6 set of coordinates are substantially equal; and 

-■4. 

s 7 means to modulate the first image component based on the average energy of the 
p8 difference between the block in the future field and the block in the past field. 

ry 
III 

pi 65. The set- top box as recited in claim 60, fiirther comprising: 

^ means to modulate the second image component based an average energy ("ae J") of 

3 a difference between a block in a fiiture field and a prediction of the block in a 

4 past field scaled by an image difficulty of a block ("BAI") in the current field. 

1 66. The method of claim 62, fiirther comprising: 

2 means to scale aed by BAI to produce a modulation factor (also referred to as Ra); 

3 and 

4 means to determine if Ra and aed are larger than a threshold value, and if Ra and aed 

5 are larger than the threshold value, modulate a second image component based 

6 on an average energy ("aed") of a difference between a block in a future field 

7 and a prediction of the block in a past field scaled by an image difficulty of a 

8 block ("BAI") in the current field. 
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67. The set-top box as recited in claim 66, further comprising: 

means to compute a motion for a block of samples, wherein an interpolated pixel is 
produced if the motion of a block of samples is less than a threshold value; 
means to modulate a first image component; 
means to adjust the'second image component; and 

means to sum the modulated first image component and the adjusted second image 
component to produce an interpolated pixel. 

68. The set-top box as recited in claim 66, further comprising: 

means to compute the amount of motion for a block of samples, wherein if the 

amount of motion for the block of samples is greater than a threshold value, an 
interpolated pixel is produced; 

means to modulate a first image component; 

means to adjust a second image component, further comprising: 

means to reduce the second image component by a factor, wherein the factor 
(also referred to as "Rm") is computed by scaling aed by aedO. 

69. The set-top box as recited in claim 60, fiirther comprising: 
means to modulate the first image component, further comprising: 

means to sum an ascending term, comprising: 

means to increase a fu-st modulation factor by a function increasing as 

the motion of the block increases; and 
means to sum a descending term, comprising: 

decreasing a second modulation factor by a function decreasing as the 
motion of the block increases. 



-35 - 



